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3 0) , |gLWttcJ:5^fS7^'>3>*^ (X-f^T'S 
3 1), M&'0ici:mW7i^iy3yh'^m\-n (X 
T-yyS3 2) o V^S. ^l&7^7>/3yT'fcnff. 20 
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^Jr^oicLtct^ib. |B|i;7^'->3yT'feoTfe, ^'<D7 

^i/a ylcimmmMcit- C T 7 i7 i/ 3 y^fSijIt^^ 

itt^^c ti)'^xt. 7^yayMm^t(DmL-^m'^ 

3>A^tI^5(Jii\ 3SL?^)?gto/cWJ5»){'Pii*f), * 
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PROBLEM TO BE SOLVED: To provide a non-boring action response system 
by modifying an action depending on an action object person even as for tlie 
same action in the case of executing a performance corresponding to the action 
of a human being and realizing the action corresponding to the degree of 
intimacy with the action object person. 

SOLUTION: A CPU 1 recognizes the action object person by collating 
Voiceprint' an "face image' registered in a table for respective individuals 
preliminarily as individual identification information for identifying the action 
object person with the Voiceprint' and the 'face image' from a voice input part 3 
and an image input part 4, and changes the corresponding action on the basis of 
a 'lever indicating the degree of the intimacy with the object person. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the action response system whicli performs correspondence 
actuation according to human being's action In the condition that the 
identification information for detecting human being's action as external world 
information, and also discriminating an action candidate from an external world 
information detection means to detect the man's description information is 
registered beforehand While recognizing the man as an action candidate by 
collating the description information detected by said external world information 
detection means, and said identification information registered An external world 
information recognition means to recognize action of the candidate concerned 
detected by said external world information detection means, A level judging 
means to judge a familiarity degree with the candidate concerned recognized by^ 
this external world information recognition means as an operational control level, 
The action response system characterized by providing the correspondence 
actuation control means which changes the correspondence actuation according 
to action of the candidate concerned recognized by said external world 
information recognition means based on the operational control level judged by 
said level judging means. 



[Claim 2] Said external world information detection means is an action response 
system according to claim 1 characterized by for the either having detected 
human being's action at least among the visual system image input section as 
an external world feeling function, the auditory system voice input section, and a 
tactile-sense system contact detecting element, and also detecting a body image 
or a voiceprint at least as the man's description information. 
[Claim 3] The action response system according to claim 1 characterized by 
establishing an identification information registration means to incorporate the _ 
description information detected by said external world information detection 
means as the man's identification information, and to newly register it when an 
action candidate has not been recognized with said external world information 
recognition means. 

[Claim 4] Whenever an action candidate is recognized by said external world 
information recognition means, while learning communication frequency with the 
candidate By establishing a study means to update said operational control level 
corresponding to an action candidate according to this communication frequency, 
and raising an operational control level according to communication frequency 
Said control means of operation is an action response system according to claim 
1 characterized by making it change into the activity which deepened the 
familiarity degree as actuation corresponding to action according to an 



operational control level. 

[Claim 5] The mode of operation of autonomous action which performs 
autonomously setting-operation set up beforehand, The mode-of-operation 
change means which changes the mode of operation corresponding to action 
which performs correspondence actuation according to human being's action, 
An external world information detection means to detect human being's action as 
external world information, and an external world information recognition means 
to recognize action detected by this external world information detection means, 
When the contents of action recognized by this external world information 
recognition means are the initiation demands of communication Control said 
mode-of-operation change means, and it is made to shift to the mode of 
operation of action correspondence from the mode of operation of autonomous 
action. The action response system characterized by providing the 
communication control means made to shift to the mode of operation of 
autonomous action from the mode of operation of action correspondence when 
the contents of said recognized action are the termination demands of 
communication. 

[Claim 6] It is the action response system according to claim 5 characterized by 
establishing an elapsed time supervision means measure the elapsed time from 
the last action to the next action , in the condition of said mode of operation 



corresponding to action , said communication control means canceling the mode 
of operation of action correspondence when the conventional time set up 
beforehand was exceeded , and the elapsed time measured by said elapsed 
time supervision means distinguishes ** and is over the conventional time , and 
making it make it shift to the mode of operation of autonomous action , 
[Claim 7] In the condition that the identification information for being the record 
medium which has the program code which a computer can read, and identifying 
an action candidate is registered beforehand While recognizing the human being 
as an action candidate by collating description information and said identification 
information registered of detected human being The program code which the 
computer which makes detected action of the candidate concerned recognize 
can read, The program code which the computer which makes a familiarity _ 
degree with said recognized candidate concerned judge as an operational 
control level can read, The record medium which has the program code which 
the computer which makes the correspondence actuation according to action of 
the candidate concerned change based on the judged operational control level 
can read. 

[Claim 8] The mode of operation of autonomous action which is the record 
medium which has the program code which a computer can read, and performs 
autonomously setting-operation set up beforehand. The program code which the 



computer to which the mode of operation corresponding to action which 
performs correspondence actuation according to human being's action is made 
to be changed can read, In being the program code which the computer which 
makes human being's detected action recognize can read, and the initiation 
demand of communication of said recognized contents of action Make it shift to 
the mode of operation of action correspondence from the mode of operation of 
autonomous action, and when said recognized contents of action are the 
termination demands of communication The record medium which has the 
program code which the computer made to shift to the mode of operation of 
autonomous action from the mode of operation corresponding to action can 
read. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the action response system 
which performs correspondence actuation according to human being's action, 



and its program documentation medium. _ 
[0002] 

[Description of the Prior Art] What performs correspondence actuation for which 
shows the user the document like the adventure game by text input as an action 
response system which answers by dialogic operation by human being's action, 
recognizes in the range to which a user's response was restricted, answers 
actions, such as addressing, from human being conventionally like the thing 
which carries out a game as a scenario or an electronic toy, or an animal mold 
robot, and it opts beforehand is known. By the way, in recent years, the animal 
mold robot as an action response system progresses remarkably, has a feeling 
function and recognizing ability, answers action from human being and is made 
to hold false actuation, conversation, etc. of an animal. 
[0003] 

[Problem(s) to be Solved by the Invention] However, in such an action response 
system, even if it was action from whom, when it was action of the same 
contents, same correspondence actuation is always performed and there was a 
fault of getting bored immediately. Moreover, although it is made to carry out by 
switch actuation in the former when changing from the condition of autonomous 
action to the operating state of the autonomous action from the operating state 
corresponding to action conversely to the operating state of action 



correspondence, although the setting-operation set up beforehand is repeated 
autonomously and it is made to perform it, except when performing actuation 
corresponding to action, it is unnatural and it becomes to change false action of 
an animal by switch actuation with the thing it was missing to the reality. 
[0004] When performing correspondence actuation according to human being's 
action, even if the technical problem of the 1st Invention is the same action, it is 
enabling it to offer the action response system by which the weariness which the 
action candidate could change the actuation corresponding to action according 
to someone, could realize correspondence actuation which deepened familiarity 
according to the degree of communication, and avoided monotonous 
correspondence actuation does not come. The technical problem of the 2nd 
invention is [0005]. [ be / it / enabling it to provide the action response system 
which realizes the change which could avoid an unnatural change called switch 
actuation, could carry out the change to pole nature, and was rich in the reality, 
when changing the mode of operation of autonomous action which performs 
autonomously setting-operation set up beforehand, and the mode of operation 
corresponding to action which performs correspondence actuation according to 
human being's action ] The means of this invention is as follows. In the action 
response system which performs invention (1st invention) of the 1st publication 
of claim correspondence actuation according to human being's action In the 



condition that the identification information for detecting human being's action as 
external world information, and also discriminating an action candidate from an 
external world information detection means to detect the man's description 
information is registered beforehand While recognizing the human being as an 
action candidate by collating the description information detected by said 
external world information detection means, and said identification information 
registered An external world information recognition means to recognize action 
of the candidate concerned detected by said external world information detection 
means, A level judging means to judge a familiarity degree with the candidate 
concerned recognized by this external world information recognition means as 
an operational control level, When action of the candidate concerned has been 
recognized by said external world information recognition means, the 
correspondence actuation control means which changes the correspondence^- 
actuation according to the action based on the operational control level judged 
by said level judging means is provided. Moreover, the record medium which 
recorded the program code for performing each function mentioned above to a 
computer, respectively is offered. 
[0006] In addition, this invention may be as follows. 

(1) Said external world information detection means detects human being's 
action by the either at least among the visual system image input section as an 



external world feeling function, the auditory system voice input section, and a 
tactile-sense system contact detecting element, and also detects a body image 
or a voiceprint at least as the man's description information. 

(2) When an action candidate has not been recognized with said external world 
information recognition means, establish an identification information registration 
means to take in the description information detected by said external world 
information detection means as the man's identification information, and to newly 
register it. 

(3) Change said control means pf operation into the activity which deepened the 
familiarity degree as actuation corresponding to action according to an 
operational control level by establishing a study means to update said 
operational control level corresponding to everybody according to this 
communication frequency, and raising an operational control level according to 
communication frequency, while learning communication frequency with that 
candidate, whenever an action candidate is recognized by said external world- 
information recognition means. Therefore, in invention according to claim 1, 
when performing correspondence actuation according to human being's action, 
even if it is the same action, the action candidate can change the actuation 
corresponding to action according to someone, correspondence actuation which 
deepened familiarity according to the degree of communication can be realized, 



and the action response system by which the weariness which avoided 
monotonous correspondence actuation does not come can be offered. 
[0007] The mode of operation of autonomous action which performs 
autonomously setting-operation to which invention (2nd invention) of the 5th 
publication of a claim is set beforehand, The mode-of-operation change means 
which changes the mode of operation corresponding to action which performs 
correspondence actuation according to human being's action, An external world 
information detection means to detect human being's action as external world 
information, and an external world information recognition means to recognize 
action detected by this external world information detection means, When tha, 
contents of action recognized by this external world information recognition 
means are the initiation demands of communication Control said 
mode-of-operation change means, and it is made to shift to the mode of 
operation of action correspondence from the mode of operation of autonomous 
action. When the contents of said recognized action are the termination 
demands of communication, the communication control means made to shift to 
the mode of operation of autonomous action from the mode of operation of 
action correspondence Is provided. Moreover, the record medium which 
recorded the program code for performing each function mentioned above to a 
computer, respectively is offered. 



[0008] in addition, in the condition of said mode of operation corresponding to 
action, an elapsed-time-supervision means to measure the elapsed time from 
the last action to the next action is established, and when the conventional time 
set up beforehand was exceeded, and the elapsed time measured by said 
elapsed-time-supervision means distinguishes ** and is over the conventional 
time, said communication control means cancels the mode of operation of action 
correspondence, and is made to shift to the mode of operation of autonomous 
action - it may be made to carry out. Therefore, when changing the mode of 
operation of autonomous action which performs autonomously setting-operation 
set up beforehand in invention according to claim 5, and the mode of operation 
corresponding to action which performs correspondence actuation according to 
human being's action, an unnatural change called switch actuation can be 
avoided, the change can be carried out to pole nature, and the action response 
system which realizes the change which was rich in the reality can be provided. 
[0009] 

[Embodiment of the Invention] Hereafter, 1 operation gestalt of this invention Is 
explained with reference to drawing 1 - drawing 4 . Drawing 1 is the block 
diagram having shown the whole animal mold robot (pet robot) configuration in 
this operation gestalt. It is made to give this animal mold robot autonomous 
action which performs autonomously setting-operation which has the image 



input section of a visual system, the voice input section of an auditory system, 
and the contact detecting element of a tactile-sense system, and can perform 
correspondence actuation (conversation/action) according to human being's 
action (a gesture / addressing / contact) as an external world feeling function, 
and is beforehand set up except the actuation corresponding to action. And even 
if it is the same action, the action candidate can change the actuation 
corresponding to action according to someone, and it enables it to perform the 
change to the mode of operation and the mode of operation of autonomous 
action corresponding to action in the actuation corresponding to action according 
to the contents of action from human being. 

[0010] CPU1 is arithmetic and program control which controls actuation by this 
whole animal mold robot according to the operating system and the various 
application software in the storage section 2. An operating system, various 
application software, etc. are stored and the storage section 2 has magnetic, 
optical, the record medium constituted by semiconductor memory etc., and its 
drive system. This record medium is a medium of portable molds, such as 
CD-ROM and the floppy disk with which it can equip free [ the fixed medium or 
fixed attachment and detachment of a hard disk etc. ], a RAM card, and a 
magnetic card. Moreover, CPU1 can incorporate the part or all that is stored in a 
record medium from other devices side, and new registration or additional 



registration can also be carried out at a record medium. 

[0011] On the other hand, to this animal mold robot, it has the voice input section 
3 of an auditory system, the image input section 4 of a visual system, and the 
contact detecting element 5 of a tactile-sense system as an external world 
feeling function, and they are connected to CPU1 as an input peripheral device. 
The voice input section 3 consists of an AID converter, micro FON, and an echo 
canceller circuit, inputs external world voice, carries out A/D conversion of the 
voice wave, and detects human being's action (addressing) as external worldL. 
information, and also it constitutes the auditory system feeling function to detect 
the human being's description information (voiceprint). The input voice from the 
voice input section 3 is incorporated by CPU1, and voice analysis is carried out. 
While CPU1 carries out the language recognition of the contents of the 
addressing as a result of voice analysis, he is trying to recognize the action 
candidate's description (voiceprint) here. 

[0012] The image input section 4 is constituted by the digital still camera, It 
carries out the seriography of a robot's perimeter for every predetermined timing, 
changes the photography image into a digital image, and detects human being's 
action (gesture) as external world information, and also it constitutes the visual 
system feeling function to detect the human being's description information (face 
image). Image analysis of the digital image by which automatic photography was 



carried out is incorporated and carried out to CPU1 by this image input section 4, 
In this case, while CPU1 recognizes human being's action (gesture) according to 
that analysis result, in order to identify that action candidate, it collates the 
identification information (face image) and the photography image which are 
registered beforehand, and he is trying to recognize an action candidate. The 
contact detecting element 5 has a pressure-sensitive type sensor, a body 
capacity detection mold sensor, etc. which have been arranged to the 
predetermined field of a robot body, constitutes the tactile-sense system feeling 
function to detect human being's action (contact) as external world information, 
and gives it to CPU1 by making into a digital signal the sensor output which has 
sensed contact of human being. He is trying for CPU1 to recognize the contact 
location of which location was contacted according to the detection result here. 
[0013] Moreover, to this animal mold robot, it has the audio response section 6, 
the movable right hand side 7, and the drive section 8. When performing a 
conversation response ta human being's action, the audio response section 6 
carries out [ voice ] an utterance output from SUPIKA, and CPU1 generates the 
speech information which carries out a conversation response, and it makes it 
output it from the audio response section 6. The movable right hand side 7 is the 
device section which operates the moving part (hand and foot, a neck, an eye, 
opening, etc.) of a robot body, and the drive section 10 is equipped with a motor. 



a power source, and a drive, and it is a driving source to the movable right hand 
side 7. In this case. CPU1 is supervising the condition of moving part mentioned 
above during the actuation corresponding to action, and is controlling the 
initiation timing of the following actuation corresponding to action. 
[0014] And the program which controls actuation by this whole animal mold roboT 
is stored in the storage section 2. That is, a system program 2-1, the 
autonomous action actuation program 2-2, the language recognition program 
2-3, the image recognition program 2-4, the recognition program 2-5 of operation 
(gesture), the contact recognition program 2-6, the table 2-7 of operation 
corresponding to action, the program 2-8 of operation corresponding to action, 
the table 2-9 according to individual, and the software timer 2-10 are stored. In 
addition, the table 2-7 of operation corresponding to action is a program control 
table which memorizes the program management information of operation for 
accessing the program 2-8 of operation corresponding to action, and carrying 
out call assignment of the program of the class according to the contents of 
action of operation in order to perform correspondence actuation 
(conversation/action) according to human being's action (a gesture / addressing 
/ contact). The software timer 2-10 will be a timer which measures the elapsed 
time from the last action, if there is which no action into the mode of operation 
corresponding to action. 



[0015] The table 2-9 according to individual has composition shown in drawing 2 . 
That is, the table 2-9 according to individual has the composition of memorizing 
a "face image", a "voiceprint", "the count of a dialogue", and "level" for every 
user. A "face image" and a "voiceprint" are the identification information 
registered beforehand, in order to identify an action candidate, and the level "the 
count of a dialogue" indicated the operational control level which is the contents 
of study updated as communication frequency with the candidate, and by which 
"level" is updated according to "the count of a dialogue" whenever an action 
candidate is recognized, i.e., a familiarity degree, to be is shown. In this case, 
even if it is the same action by raising "level" as communication frequency 
increases, he is trying to change into the actuation corresponding to action which 
deepened the familiarity degree, even if the table 2-7 of operation corresponding 
to action is action of the same contents, in order [ namely, ] to perform actuation 
corresponding to different action according to the "level" which shows a 
familiarity degree - every class of action - "level" ~ he is trying to memorize 
another program management information of operation 

[0016] Next, it explains with reference to the flow chart which shows the 
actuation of an animal mold robot in this 1 operation gestalt to drawing 3 and 
drawing 4 . Here, the program for realizing each function described by these flow 
charts is stored in the storage section 2 with the gestalt of the program code 



which can be read, and CPU1 performs actuation according to this program 
code serially. Drawing 3 is the flow chart which showed system-wide actuation. 
First, in connection with powering on, the autonomous action actuation program 
2-2 is started, an automatic change is carried out at the mode of operation of 
autonomous action (step S1), and autonomous action actuation is made to start 
(step S2). In this condition, when contact existence (step S3), input voice 
existence (step S13), and human being's existence (is the person included In the 
photography image?) are distinguished (step S14) and all are distinguished from 
"it is nothing", accessing the voice input section 3, the image input section 4, and 
the contact detecting element 5, it returns to step S2 and actuation of 
autonomous action is continued. 

[0017] When those with contact are now detected based on the sensor output 
arranged to the predetermined field of a robot body, a photography timing signal 
is given to (step S3) and the image input section 4, the image in which the 
seriography was carried out by search actuation of a perimeter image is 
captured, and It distinguishes whether human being Is contained in it (step S4, 
S5). Here, if human being is not in a perimeter, it returns to step S2 and 
autonomous action actuation is continued, but if there is human being, it will 
change to the mode of operation corresponding to action (interactive mode) 
(step S6). And it distinguishes whether the face image was able to be extracted 



from the inside of a photography image as that man's description information, 
and the "face image" in [ classified by individual ] a table 2-9 was able to be 
searched based on this extract image, consequently the registered person was 
able to be specified (steps S7 and S8). 

[0018] In this case, if it is a non-registered person, the table 2-7 of operation 
corresponding to action will be accessed, the correspondence actuation 
program of the first meeting will be called from the program 2-8 of operation 
corresponding to action, and actuation corresponding to the first meeting will be 
performed (step S9). In this condition, it investigates whether voice input 
occurred (step S10), if there is nothing, it will return to step S1 and will change to 
the mode of operation of autonomous action, but if voice input occurs, it wilL 
move to new registration processing. Namely, although this new registration 
processing generates a new record and performs additional writing in [ classified 
by individual ] a table 2-9 In that case, as item data of "level", a lowest level is set 
(step S11) and the face image extracted from this photography Image as item 
data of a "face image" and a "voiceprint" and the voiceprint obtained by 
analyzing input voice are set (step S12). Then, it moves to step S22, and 
although dialogue actuation of drawing 4 which wanted to carry out a flow chart 
is performed, about the activity, it mentions later. On the other hand, if it is 
contact from a registered person when a person is able to be specified at step 



S8 that is, after moving to step S20, accessing the applicable record in 
[ classified by individual ] a table 2-9, judging a specific person's "level" and 
making the actuation corresponding to the confrontation according to the 
judgment level start (step S21), it will move to step S22 and dialogue actuation of 
drawing 4 which wanted to carry out a flow chart wilj be performed. 
[0019] On the other hand, when it sets working [ autonomous action ] and those 
with voice input are distinguished, (step S13) and the language recognition 
program 2-3 are started, a language recognition is performed based on input 
voice (step S15), and it distinguishes whether the appeal to self, i.e., the 
language for which it opts beforehand, was inputted (step S16). Consequently, 
to self, if, it returns to step S2, autonomous action actuation is continued, if it is 
the appeal to self, voice collating will be performed with reference to the 
"voiceprint" in [ classified by individual ] a table 2-9, and it distinguishes whether 
the person has been specified (steps S17 and S18). Consequently, dialogue 
actuation is performed after moving to step S20 after changing to an interactive 
mode (step S19), and making the actuation corresponding to the confrontation 
according to "level" start, when it was a non-registered person and a person is 
able to be specified, although it returns to step S4 (step S22). When it is 
distinguished that set working [ autonomous action ] and human being is 
contained in a photography image, moreover, the (step S14), On condition that 



the person was able to be specified with the image, (Step S23), When it is not 
able to specify although dialogue actuation is performed (step S22) after 
changing to the interactive mode (step S24) and making the actuation 
corresponding to the confrontation according to "level" start (steps S20 and S21), 
it returns to step S2 and autonomous action actuation is continued. 
[0020] Drawing 4 is the flow chart which explained above-mentioned dialogue 
actuation in full detail, and performs correspondence actuation 
(conversation/action) according to human being's action (a gesture / addressing- 
/ contact). That is, if one of actions occurs (step S30), voice action by addressing 
or action of operation by (step S31) and the gesture will be distinguished (step 
S32). Now, if it is voice action, will perform a language recognition (step S33), 
will distinguish whether the language denotes "termination" of the actuation 
corresponding to action (step S34), and If it is not "termination" directions Extract 
the man's "level" from the inside classified by individual of a table 2-9, and the 
table 2-7 of operation corresponding to action is accessed according to voice 
action and its "level." Correspondence actuation (audio response) according to 
the program of operation called from the program 2-8 of operation corresponding 
to action is performed (step 835). And after adding "the count of a dialogue" in 
the table 2-7 of operation corresponding to action "1" and counting up the value 
(step S36), it becomes the following action waiting (step S30). 



[0021] Moreover, when it is distinguished that it is action of operation by the 
gesture, (step S32) and the gesture recognition program 2-5 are started, 
recognition of operation is performed (step S39), and correspondence actuation 
(response of operation) according to the man's "level" is performed (step S40). 
And after counting up the man's "count of a dialogue" (step S41), it becomes the 
following action waiting (step S30). Furthermore, when it is distinguished that it is 
contact action, while starting (step S32) and the contact recognition program 2-6, 
recognizing a contact condition (step S42) and performing correspondence 
actuation (response of operation) according to the man's "level" (step S40), after 
counting up the man's "count of a dialogue" (step S41), it becomes the following 
action waiting (step S40). 

[0022] If voice action directs "termination" of the actuation corresponding to 
action during such actuation corresponding to action (step S34), after performing 
termination actuation (step S39), the "level" concerned will be updated according 
to "the count of a dialogue" in table 2according to individual-9 (step S38). And 
step S1 of drawing 3 is made to shift to the mode of operation of autonomous 
action from return and an interactive mode. Moreover, when there was which no 
action into the mode of operation corresponding to action and it is distinguished 
at step S43 in this action waiting state that timer measurement time amount 
reached fixed time amount although it becomes the waiting for action after 



carrying out the clear start of the software timer 2-10 which measures the 
elapsed time from the last action, actuation which presses for action is 
performed (step S44). And if there is no action even if it performs reminder 
actuation, after moving to step S37 and performing termination actuation, an 
interactive mode is canceled and it is made to shift to the mode of autonomous 
action, although it distinguishes whether it is with action (step S45), and it will 
return to step S31 if it is. 

[0023] as mentioned above, this 1 operation gestalt - as identification 
information for identifying an action candidate, if it is By collating the "face 
image" and the "voiceprint" which are beforehand registered into [ classified by 
individual ] the table 2-9, and the "face image" from the voice input section 3 and 
the image input section 4 and a "voiceprint" Since the actuation corresponding to 
action was changed based on the "level" which recognizes an action candidate 
and shows a familiarity degree with the candidate concerned, even if it is the 
same action By the action candidate being able to change the actuation 
corresponding to action according to someone, and realizing correspondence 
actuation according to a familiarity degree with an action candidate It becomes 
the correspondence actuation which deepened familiarity and it becomes 
possible to offer the animal mold robot which avoided monotonous 
correspondence actuation and by which weariness does not come, so that 



communication increases. Moreover, when an action candidate lias not been 
recognized, since the man's information was newly automatically registered into 
[ classified by individual ] the table 2-9, a user is not restricted but anyone 
becomes usable freely. 

[0024] Moreover, the mode of operation of autonomous action which performs 
autonomously setting-operation set up beforehand, When the mode of operation 
corresponding to action which performs correspondence actuation according to 
human being's action is changed, Are not based on switch actuation like before, 
but when the contents of action are the initiation demands of communication 
Make it shift to the mode of operation of action correspondence from the mode of 
autonomous action, and when the contents of action are the termination 
demands of communication Since it was made to make it shift to the mode of 
autonomous action from the mode of operation corresponding to action, it 
becomes switchable by actions, such as addressing, and the change which was 
rich in the reality Is attained as an approach of operating the animal mold robot 
of false action. In this case, since the mode of operation of action 
correspondence is canceled and it was made to make it shift to the mode of 
autonomous action when the elapsed time from the last action to the next action 
exceeded fixed time amount, a mode change becomes unnecessary. 
[0025] in addition - although the face image and the voiceprint were collated in 



the 1st operation gestalt mentioned above when an action candidate was 
identified - not only a face image but height - it grows fat, the physical^ 
descriptions, such as condition and a hairstyle, are detected, and you may make 
it identify Moreover, although communication frequency was made into "the 
count of a dialogue", you may be time spacing or a time rate from the last action 
to the next action etc. Moreover, you may be a virtual animal, a pet, etc. on the 
display screen not only by an animal mold robot but software. 
[0026] 

[Effect of the Invention] When performing correspondence actuation according 
to human being's action according to the 1st invention, even if it is the same 
action, the action candidate can change the actuation corresponding to action 
according to someone, correspondence actuation which deepened familiarity 
according to the degree of communication can be realized, and the action 
response system by which the weariness which avoided monotonous 
correspondence actuation does not come can be offered. When changing the 
mode of operation of autonomous action which performs autonomously 
setting-operation set up beforehand, and the mode of operation corresponding., 
to action which performs correspondence actuation according to human being's 
action according to the 2nd invention, an unnatural change called switch 
actuation can be avoided, the change can be carried out to pole nature, and the 



action response system which realizes the change which was rich in the reality 
can be provided. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] The block diagram having shown the whole animal mold robot 
configuration. 

[Drawing 2] Drawing having shown the configuration of the table 2-9 according to 
individual. 

[Drawing 3] The flow chart which showed system-wide actuation. 

[Drawing 4] The flow chart for explaining the dialogue actuation shown by 

drawing 3 in full detail. 

[Description of Notations] 

1 CPU 

2 Storage Section 

3 Voice Input Section 

4 Image Input Section 

5 Contact Detecting Element 



6 Audio Response Section 

7 Movable Right Hand Side 

8 Drive Section 

2-9 Table according to Individual 



